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(-H Abstract 

^ In this paper we investigate the approximation properties of kernel interpolants on manifolds. The 

a kernels we consider will be obtained by the restriction of positive definite kernels on W', such as radial 

, , basis functions (RBFs), to a smooth, compact embedded submanifold M C K''. For restricted kernels 
having finite smoothness, we provide a complete characterization of the native space on M. After this 

^Sl and some preliminary setup, we present Sobolev-type error estimates for the interpolation problem. 

^ Numerical results verifying the theory are also presented for a one-dimensional curve embedded in R^ 

•y~i and a two-dimensional torus. 
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• 1 Introduction 

^-^ Kernels have proven to be quite useful in the approximation of multivariate functions given scattered data, 

^-H and perhaps the most rudimentary problem of this type is that of interpolation. Let fi be a metric space, 

L| and let </) : f2 x i7 — > M be a function (which we will refer to as a kernel). Given a target function / : i7 — > M 

. ^H and a finite set of distinct nodes X — {xi, X2, ■ ■ . , xj^} C fi, one can seek an interpolant Ix,4>f via shifts of 

^^ 0, i.e. Ix,<f>f takes the form 

Ix,4,f ^'^Cj(j){-,Xj), 

3 

and satisfies Ix,4>f\x = f\x- Finding the appropriate coefficients Cj is a matter of inverting the Gram matrix 
with entries Aij = (j){xi,Xj), which is always theoretically possible if is positive definite. The kernel can 
also be used to construct more general interpolants, such as those where the data is generated from various 
types of linear functionals (integral data, derivative data, etc.) [3T1I3S]. However, in this paper we will focus 
on the traditional interpolation problem. 

Although kernel approximants were initially considered with the domain being a Euclidean space or a 
sphere [43] , the ideas have since been generalized enough to handle functions defined on other mathematical 
objects. Kernels have been studied that are positive definite on various Riemannian manifolds ^W[ [?fl[^ . 
and there are also kernels that exploit the group structure of their underlying manifold, with domains such 

*Research supported by grant ATM-0801309, DMS-0934581, and DMS-0540779 from the National Science Foundation. 
2010 MSC: Primary 41A05, 41A25, 41A30, 41A63; Secondary 65D05, 46E22. 
Key words and phrases: kernel, radial basis functions, scattered data, interpolation, manifold. 



Lie groups, projective spaces, and motion groups [121 [TH |47j . These kernels are obtained in various ways in 
the literature. Some are defined through manifold charts, some are acquired via a special expansion in terms 
of eigenfunctions of the Laplace-Beltrami operator, and others are assumed to be the Green's function for 
some pseudo-differential operator. Here the kernels can be highly dependent on the underlying manifold. 

In all of the cases discussed above, the domains involved are finite-dimensional smooth manifolds and, 
according to the Whitney embedding theorem, any such manifold M can be embedded into some W^' (in fact, 
Nash's embedding theorem guarantees that this can be done isometrically). Positive definite kernels on M"^ 
are easy to come by, so another, seemingly naive, way of obtaining a positive definite kernel on M is simply 
by the restriction of a kernel defined on the ambient space. More precisely, given a kernel </) : M"* x M"* — > M 
and an embedded manifold M C M'*, we define 

^i' '•) -^ H- : OImxm- 

If (j) is positive definite, so is its restriction to M, making ijj well-suited for interpolation problems. Although 
the practical value of using such a kernel is not clear in all of the aforementioned situations, in this paper 
we will see that it is theoretically and numerically possible to approximate functions defined on manifolds 
with simple kernels defined on the ambient space. 

While the benefits of approximating with a kernel intrinsic to the manifold cannot be questioned, there 
are many applications for which an incomplete knowledge or manageable mathematical description of the 
underlying manifold may prevent the construction of the intrinsic kernel. For example, in problems from 
computer aided design, graphics and imaging, and computer aided engineering the manifold may be a physi- 
cally relevant geometric object (such as an airplane wing) and a scalar field (such as pressure or temperature) 
may need to be interpolated at arbitrary locations over the object HI [S] [TUl UHl EH ■ Additionally, in prob- 
lems from learning theory, data samples are from a very high dimensional space, but are usually assumed to 
lie on a relatively low dimensional embedded submanifold that is virtually unknown [6]. Finally, there has 
been much recent interest in approximating derivatives of scalar and vector valued quantities on manifolds in 
both the graphics (cf. [51[TT1|35]) and computational fluid dynamics (cf. [I] |H1 133 EZl SI] ) communities. These 
approximations are typically used for numerically solving partial differential equations defined on manifolds 
(such as the surface of a biological cell or membrane) for modeling processes like advection-reaction-diffusion 
of chemicals or fluid flows on the surfaces. Reconstruction of a function on the underlying manifold is 
typically first required to then approximate its derivative. 

In all the applications referenced above, the manifold could be represented by a triangular mesh, points 
on an implicit function (level set), or more generally by a point cloud in M.^. Since the restricted kernel 
method under consideration in this study is mesh-free, it applies easily to all of these cases. Additionally, 
the kernel's smoothness can be increased so that derivatives of the interpolant are well-defined everywhere on 
the surface. Finally, the method is based on extrinsic coordinates, which naturally bypasses any coordinate 
singularities inherent to a manifold-based coordinate system, as shown for the unit sphere S^ in |15j . 

To the authors' knowledge, these restricted kernels have only been studied in the special case of M = 
E>^^^ C M.'^ (23 HH]. The kernels considered in these papers are radial on M'*, i.e. (t>{x,y) — (t>{\\x — y||), 
and it just so happens that the restriction of a radial function on K^ to the sphere is zonal, meaning that 
it depends only on the geodesic distance between its arguments. Even on more general manifolds, when 
the kernel possesses such a property there are powerful tools at one's disposal - most notably one has a 
convenient Fourier expansion of the kernel in terms of eigenfunctions of the Laplace-Beltrami operator 36! . 
Of course, in the setting we consider here the restricted kernel will not necessarily be zonal. To circumvent 
this and other issues, we will appeal to the variational theory of Madych and Nelson, and also to the error 
analysis of Narcowich et. al. [2H [S^ ■ 

The paper is organized as follows. In the next section we introduce the necessary preliminaries, notation 
for manifolds, Sobolev spaces, and other essential tools. After that, we will characterize the native space, 
in terms of concrete function spaces, for a large class of kernels that have been restricted to embedded 
submanifolds. We will then make a brief detour into measuring the distribution of sample points on embedded 
submanifolds. This will poise us to present interpolation error estimates for both smooth and rough target 
functions, which are the main results of the paper. We conclude with numerical results verifying the two 
main error estimates from the paper. 



2 Notation and Preliminaries 

We will restrict our study to smooth, connected, compact manifolds with no boundary. For the reader 
unfamiliar with manifolds, an excellent reference is Lee's book [5T]. A fc-dimensional manifold M is defined 
as a topological space M which is locally identified with W' via a collection of smoothly compatible coordinate 
charts. More specifically, there is an atlas A = {{Uj, ^j)} of open sets Uj C M whose union covers M, and 
associated smooth one-to-one maps ^j : Uj — >■ K*^ such that any transition map VPj o \|/^^ is a smooth map 
where it is defined. By refining the charts as necessary, one may assume that the image of any chart is equal 
to an open ball around the origin. Also, since the manifolds we consider are compact, we can obviously 
assume that any atlas encountered has finitely many charts. 

2.1 Embedded Submanifolds in M"' 

In addition to the features described previously, the manifolds we consider throughout the paper will be 
embedded submanifolds of M"^. However, we warn that authors use the term "embedding" to mean different 
things in similar situations. This topic can be subtle, so a precise statement of what we consider to be an 
"embedded submanifold" is in order. We will follow the definition used in [3T1 Chapter 7], although we state 
it in less generality. This will require a few preliminary terms. 

Let M C K'^ be a smooth manifold endowed with the subspace topology. Given a; G M, we will denote 
the tangent space of M at a; by T.J.M.. If F : M — ?► M'^ is a smooth map, the rank of F at a: e M is the rank 
of the Jacobian map F^, : T^fA — > Tpj^jlR''. A smooth map is called an immersion if F^, is injective at each 
point, i.e. the rank of F is equal to dim (M). We say that a manifold M is an embedded submanifold of M'^ if 
the inclusion map i : M ^-> M'' is also an immersion. Some authors call such manifolds regular submanifolds. 

2.1.1 Slice Charts 

There is an equivalent, local characterization of embedded submanifolds, which uses charts that utilize the 
ambient space [51] Chapter 8]. Given an embedded fc-dimensional submanifold M C M'', there is an atlas 
A — {{Uj, ^j)}, where the sets Uj are open in M.'^ and cover M, and each ^j is a 1 — 1 smooth map from Uj 
to some ball around the origin, say B{0,rj), that "straightens" the manifold. By this we mean that 

^j{MnUj)cB'{0,rj), 

where B'{0, rj) = {?/ G i?(0, rj) \ yt+i = yk+2 — ■ ■ ■ — Vd — 0} can be viewed as a copy of an open ball in M*^. 
The charts {Uj, ^j) are sometimes referred to as slice charts. If we define Uj := M n Uj and ^j := '^jlu- , 
then A = {(^j, Uj)} is an atlas for M in the usual sense. As before, one can assume that '^j : Uj — > B'{0, rj) 
and "ij : Uj — > B{0, rj) are bijections without any loss of generality. 

2.1.2 Distances on Embedded Submanifolds 

If M is an embedded submanifold of M'', its topology is naturally induced by the Euclidean metric. This 
being the case, M automatically inherits a distance function Jm : M x M — > M. Assuming M is connected, 
given x,y € M. we can define the distance between x and y to be 

dM{x,y) := inf / ||7'(t)|| dt, 
t-[o,i]^mJq 

7(0) = a: 
t(1) = !/ 

where 7 is any piecewise smooth curve in M beginning at x and ending at y, and ||7'(t)|| is the Euclidean 
length of the tangent vector j'{t). Given an x e M, we denote by Bm{x, r) the open ball of radius r centered 
at X, i.e. BM{x,r) — {y G M \ dM{y,x) < r}. In the case where the underlying manifold is M.'^ we omit the 
subscript and simply write B{x,r). 



2.1.3 Tubular Neighborhoods 

It is well known that any embedded submanifold of M*^ has a tubular neighborhood, which is a neighborhood 
of M in M'* analogous to a tube around a curve in 3-space. A precise definition of a tubular neighborhood 
would require much more notation than we need here, so we omit these details and instead present a 
useful consequence of its existence. The interested reader can find a full discussion of the subject in most 
introductory books on smooth manifolds |21) . 

Proposition 1. LetWl be a compact, smooth embedded submanifold ofM.'^. Then there exists a neighborhood 
Ue{M) ■- {y e M"* |dist(j/,M) < e} and a canonical smooth map *H : Ue(M) -> M such that D\\m is the 
identity map on M. 

In this case we call e the radius of the tubular neighborhood Ue (M) , and the map *K is called a retraction. We 
remark that by restricting the radius of the tubular neighborhood slightly we can assume that the domain 
of d\ is compact. 

2.2 Sobolev Spaces 

The class of functions we will be interested in approximating are from the Sobolev spaces, which are spaces 
that consist of all f G L^ that have distributional derivatives D^f in L^ for all multi- indices up to some 
order. For Sobolev spaces on M'', we will follow the notation of Adams j2]. Let fi be a neighborhood in M*^, 
1 < P < oo, and TO be a nonnegative integer. The associated Sobolev norms are defined via 

i/p 



For the case p = oo we have 



I |Q|<m 



|vi/™(n) := max ||D"/||L^(n)- 

\a\<in 



It is also possible to have Sobolev spaces of fractional order. Let l<p<oo,mbea non- negative integer, 
and < i < 1. We define the Sobolev space WZ""'"*(r2) to be all / such that the following norm is finite: 



v-^ f f \D°' fix) — D°' f(y)F 
\w^+\n) — I \\f\\w^{n) + z2 ii iidWt d^'^y 



i/p 



\a\=k 



nJn ||a;-y||2 



We define the Sobolev spaces on embedded submanifolds as follows. Let M C M"^ be a compact sub- 
manifold of dimension k. Let A — {{Uj, ^j)} be an atlas of slice charts for M, and let A ~ {{Uj, ^j)} be 
the associated intrinsic atlas. Now let {Xj} be a partition of unity subordinate to {Uj}. If / is a function 
defined on M, we have the projections 7Tj{f) : M*^ — > M by 

7:(f)(v)-l ^^/(*7'(2^)) yei?'(0,r,) 
''^^^^^^^"\ otherwise. 

Using this construction, one can now define Sobolev spaces for 1 < p < oo and s > via the norms 

1/2 



i/IU=(M):- Ell^^-(/)l" 



N 



where N is obviously the number of charts in the atlas. The norm for Wp{M.) obviously depends on the 

particular choice of atlas A and the partition of unity. However, if one uses different collections of these 
objects, the same space arises and the norms are equivalent (the details for the case d = fc — 1 can be found 
in Lions and Magenes [25]; foi' general k < d the argument is similar). Also, as is customary in the case 
p = 2 we define if"(M) := M^|(M). 



2.3 Traces 

Given any subset fl C M'', one has a continuous trace operator Tji : C(IR'^) — > C(0) that acts on functions 
by restricting them to fl, i.e. TQ,{f) — /|o. Extending the trace operator to other classes of functions is a 
weh-studied subject (see [21 Chapter VII] or [3 Chapter 5]). In the case when il is a submanifold of M'', the 
basic idea is that restricting a function / e WT(M'^) to the submanifold "costs" 1/p units of smoothness for 

each dimension, e.g. if M is a smooth submanifold of dimension k, then /|m G Wp~ ~ -^'^(M). However, 
there are restrictions. For example, when p > 2 the imbeddings do not necessarily hold when t — {d — k)/p 
is a nonnegative integer [21 Theorem 7.58]. One can get around this and other subtle issues by instead 
considering Besov spaces. Nevertheless, in the case we will be interested in, i.e. p = 2, we will not have to 
shift our focus to these spaces. The following is the trace result we require (see, for example [71 Section 25]). 

Proposition 2. Let r > and 1 < k < d. Let M. be a smooth k-dimensional compact embedded submanifold 
ofWK Then the trace operator Tm extends to a continuous operator mapping H'^{R'^) onto H'^~^'^~^'''^{fA). 
Further, there is a reverse imbedding, i.e. there is a bounded linear map Em : H'^~^'^~^>''^{M.) — > H'^ (W^) 
such that Emu\m = u for all u G iJ^"(''"*-^)/2(M). 

We emphasize that the extension Em is independent of r. 

2.4 Positive Definite Kernels and Native Spaces 

Let J7 C M'', and recall that an A^ x iV matrix A is positive definite if given any nonzero c G M^, the quadratic 
form c'^ Ac is strictly positive. We say that a kernel </) : J7 x J7 — > M is positive definite on fl if given any 
finite set of distinct nodes {xi, X2, ■ ■ ■ , xn} C fl, the N x N Gram matrix with entries Aij — 4>{xi, Xj) is 
positive definite (and hence invertible). All of the kernels we consider in this paper have this property, so we 
will take "kernel" to mean "positive definite kernel." A kernel that depends only on the distance between 
its arguments, i.e. (f){x,y) = (j}{\\x — y\\), is called a radial basis function (RBF). This subclass of kernels is 
of particular importance; they are essentially one-dimensional. 

Typically approximation is well understood for target functions coming from the so-called native space of 
the kernel, which is a reproducing kernel Hilbert space generated by the kernel. We define the native space 
of a given kernel (/) on fi in the usual way, that is by taking the closure of the pre-Hilbert space 



F'P={f 



N 






in the inner-product 



N M \ M N 



\j = l fc=l / F^ k=lj=l 

We will denote the native space of (p by A/^. 

Defined in this way the native space can seem quite abstract, and characterizing it in terms of more 
well-known function spaces is helpful in finding classes of functions that can be approximated by shifts of (p. 
The structure of the native space for kernels of finite smoothness on Euclidean spaces is well-known. To be 
more specific, if is a kernel on M'' whose Fourier transform, denoted by </), has algebraic decay, i.e. 

Ho-{^ + mlr\ r>d/2, (1) 

then A/^ — H'^{M.'^) with equivalent norms. 

We end this section by stating a well-known, indispensable property of kernel interpolants. If / G JV^, 
then Ix.4>f is the orthogonal projection (in J\f^) of / onto the subspace span 0(-, Xj). This immediately gives 

Xj£X 

one 

||/-/x,0/||aA^ < ll/lk^ and \\Ix,<t,f\\Af^ < WfWM^,- 



3 Native Spaces for Restricted Kernels 

As mentioned previously, one approach to finding functions that can be approximated by a given kernel is 
to determine the native space of that kernel. In this section we characterize the native space for positive 
definite kernels that have been restricted to an embedded manifold. Let (/)(a;,2/) be a positive definite kernel 
on W^ satisfying (nj). Given an embedded submanifold M C K'', we define the kernel -i/; on M by restricting 
(j) to the manifold, i.e. 

i^i' r) := 0(- , OImxm- 

As stated in the introduction, it is clear that V' inherits the positive definiteness of (j). Thus tp generates a 
native space on M, which we denote by Af^. 

In the case of M = E}'^~-^ C M'', the native spaces of restricted RBFs have been historically studied by 
investigating the decay of the kernel's Fourier-Legendre coefficients [221115]. However, the methods used 
in these papers are difficult to apply when the manifold is more general, e.g. the connection between the 
intrinsic Fourier coefficients and Fourier transform of the extrinsic kernel might be unclear, so we need to take 
a different perspective. The arguments we use ultimately rely on the variational approach due to Madych 
and Nelson, which completely avoids the use of the Fourier transform [21] . The following is from Section 8 
of that paper. 

Proposition 3. Let fl C M'^ and let k : il x ft ^ M. be a positive definite kernel. Finally, let L{n) the set 
of linear Junctionals given by finite linear combinations of point evaluations, i.e., 

L{n) ■■= {^ = Y1 "j'^^j \ N eN, aeR'',Xj en 

Then we have f G A/'k if and only if there is a constant C f so that 

\\{f)\<Cf\\\u.. 

Further, 

WfU. = sup ^(^) 



AeL(O),A^0 II-^IIaa^ 

Before we can prove our results, we need a lemma. The following is due to Schaback [321 Section 9], 
and can also be found in Wendland's book ^H Theorems 10.46 and 10.47]. We include the proof here to 
illustrate the role Proposition [3] in our study. 

Lemma 4. Let (j) and tp be related as above. Then we have the following 

1. There is a natural linear operator E : M^ — )■ A/^ such that -E/|m = / and 

\\Ef\U^ = II/IItv^ 

2. The native spaces of 4> and ip are related via 

N^ = Tm {N4,) . 

3. The trace operator Tm : A^ — > M^p is continuous with \\Tyi\\ < 1. 
Proof. First we define the extension operator E : F^ — ^ F^ by 




N \ N 

•, Xj 



'^Cj<j){-,Xj). 



Clearly we have that ||-B/||a/',^ = ||/||a^/, for all / S F^. Now using a density argument we can extend E to 
map A/"^ to Af,p. Since E preserves norms for the dense subsets, we conclude that E is an isometry. 



For 2, it is clear from 1 that N^ C Tm (A/",/,). Focusing now on the reverse inclusion, let f £ Tm (A/",/,). 
Then there is a g G J\f^ such that T^g — /• By Proposition [31 we need to find a constant Cf such that 

|A(/)| < CfWXU. 

for all A e L(M). First, we have A(/) = A(.g) and \\X\\j^'^ = ||A||jv-* for all A e L(M), giving 

|A(/)| = |A(g)|<C,||A|^-C,||A||Ar^. 

Thus / e TV^/,. Further, note that since L{M) C L{R'^) we have 



II/IIaAv. = sup p- — = sup 

A(.g) II II 

AeL(R''),A^O ll^llAA^ 

This shows that the trace operator is continuous with norm less than one, and this completes the proof. D 

Now we are ready to present a characterization for the native space of the restricted kernel. 
Theorem 5. If (p satisfies UV, then M^ = H'^^^'''^'^'>/^(M) with equivalent norms. 
Proof. Our choice of (j) gives Af^ — H'^{R'^) with equivalent norms. By Proposition p^ and Lemma we have 

Next we show that the native space norm dominates the Sobolev norm by a constant factor. Note that 
./ = TyiEf and that the trace operator is continuous on the appropriate Sobolev spaces. Now we have 

||/||_f/^-(d-'=)/2(M) = \\TMEf\\[J^-{d-k)/2(J^-^ < C||i?/||ffx(Rd) 

< C\\EfU^=C\\fU^. 

It is a well-known consequence of the Interior Mapping Theorem that in such situations the norms must be 
equivalent. D 

4 Interpolation via Restricted Kernels 

We are ready to shift our focus to the approximation of functions within certain Sobolev spaces using 
restricted kernels. The methods we use are related to those used by Narcowich et. al. 33J, although the 
present situation is different enough so that there is still work to be done before we can successfully apply 
their methods. 

4.1 Node Measures on Submanifolds of R.'^ 

Given a finite node set X from a metric space 0, error estimates are typically given in terms of the fill 
distance, or mesh norm of the points, which is defined to be 

hx e •= sup min dQ{x,Xj), 

where de is the distance metric between x and y intrinsic to O. Another important measure is the separation 
radius, given by 

qx.e -^ min -dQ{x.j,Xk). 

Xj^Xk 

Since we wish to study approximation on a manifold, it is important that our results be stated in terms 
of the mesh norm and separation radius intrinsic to the manifold. Note that our node sets simultaneously 



reside in several different metric spaces, namely M'', M, and M.'^ (through chart mappings). We will need the 
"node measures" on all three of these spaces, and it will be convenient to put them on equal footing. This 
is not a difficult task, but it is a detail that must be dealt with nonetheless. 
First we show that qx.u ^ Qx.R'' ■ 

Theorem 6. Let M C M'' be a smooth compact em,hedded subm,anifold of dmcnsion k < d. Then dmix, y) ^ 
\\x — y\\ for all x,y Cz M.. In particular, we have qx,M ^ Qx K<* /<"" o^^ finite node sets X dWl. 

Proof. Clearly we have ||x — y\\ < dmix, y). Now we find a bound in the other direction. Since M is smooth 
and compact, we know from Proposition [I] that there is a compact tubular neighborhood f7e(M) with normal 
radius e and smooth retraction 5K : [/^(M) — > M. Given x,y e M, we consider two cases: ||a; -- 2/|| > e and 
||a; — y\\ < e. If ||a; — y\\ > e, we have 

dM{x,y).. II diam(M) 

dM(x,y) = 7r\\x~y\\ < \\x-y\\. 

\\x~y\\ e 

Now assume < ||a; — y\\ < e. Notice that y e B{x^ e) C f7e(M), so the parameterized line I : [0, 1] — > W^ 
starting at x and ending at y is completely contained in U^ (M) . Thus 91 o Z is a smooth parameterized curve 
in M starting at x and ending at y. Now we use the arclength definition of the distance metric and the fact 
that l'{t) — y ~ X to get 



dM{x,y) = inf 

7:[0,l]-l 



7(0) = 
7(1) = H 



^7 
~dt 



dt < 



jr'"> 



dt 



\\{Dm)\i(^t/{t)\\dt< / \\DD\\U\x~y\\dt 





= \\Dm\U\x-yl 

where UDO^Hoo denotes a bound on the matrix norm of the Jacobian matrix D9\, which we know to be 
bounded since *H is smooth and its domain is compact. The result now follows. D 

The reader should note that the discrepancy between qx,u and Qx.R'' could be quite large, e.g. consider 
nodes taken at the poles of a flattened ball. However, if the node set is sufficiently dense this will not be an 
issue. 

Now we shift our focus to the mesh norm. The first step is to show that distances are preserved under 
chart mappings. This has been taken care of in the case of homogeneous manifolds in [551 Proposition 3.3], 
and we cite its proof to deal with our situation. 

Proposition 7. Let M. be a compact smooth manifold of dimension k. Then there exists an atlas A = 
{(^j, C/j)} /or M and associated positive constants Ci, C2 such that for all x,y di M., if x,y ^ Uj for some j 
we have 

ci\\^j{x) - ^j{y)\\ < dmix^y) < C2||*j(a;) - *j(2;)||. 

Proof. Since M is a smooth and compact manifold, we get a smooth atlas A = {(^j, ^i)} containing finitely 
many charts for M. By refining our charts as necessary, we may assume that the images of these charts is 
equal to a ball in W' centered around the origin. Since our manifold is smooth and the images of our charts 
are convex, the arguments in the proof of [22, Proposition 3.3] follow to find positive constants ci.j and C2j 
such that 

cijll*j(a;) - *j(2/)ll < dM{x,y) < C2j^j{x) - ^,{y)\\ V x, y e U,. 

Now simply set ci :— miuj ci ., and C2 := maxj C2j, and the proof is complete. D 

From here on out, we let A = {(^j, Uj)} be such an atlas for M, with each $j being a bijection from Uj 
to some ball B'{0, rj) C M*^. In the next section we will be able to easily obtain error bounds on each chart 
in terms of the mesh norm in M'^, h^^, .(^x).B'(o,r-)- In an effort to use a mesh norm intrinsic to the manifold, 
consider the following. With the result above, we have: 



hxnUjMj ^ h^j(x),B'{o,rj), 



which gives us in particular that 

^*j(x),B'(o,rj) ^ GhxnUj,Uj- (2) 

Using this, a useful global density of X on M is h* := maxj hxnu-,u-, but this is not as strong as the mesh 
norm /ix,M- Indeed, it is not hard to show that hx,M ^ h*. However, for node sets yielding a mesh norm 
hx,u small enough, h* and hx,u are equivalent. 

Theorem 8. Let M. be a compact smooth manifold of dimension k, and let A = {{^ j, fj)} &£ a^^ atlas for 
M satisfying Proposition^ Then there exists constants hQ,C > so that for any finite node set X (Z fA 
with hx,M < h-Q, we have 

hxnUj,Uj < Chx,M for all Uj. 

Proof. Recall that we may assume that every map ^j is a smooth bijection onto a ball of radius tj > 0. 
Define r = miuj rj . We will exploit geometry of the situation by using the fact that balls satisfy an interior 
cone condition. Given a point x G M*^, unit vector ^, radius R, and angle 6 G (0,7r/2), we define the cone 

C(x, e, i?, e):={x + Xy \ ye M^ \\y\\ = 1, y^^ > cos(0), A e [0, R]}. 

Below are the geometric facts we require 44, Lemma 3.7, Lemma 3.10]: 

1. Let C{x,£^,R,d) be a cone of radius R and angle 6. If h < R/{1 + sin(6')), then the cone contains a 
closed ball of radius /isin(0) centered a distance h away from x. 

2. Every ball with radius R > satisfies an interior cone condition with radius R and angle 9 = 7r/3, i.e. 
for every x in the ball, a unit vector ^(x) exists such that C'{x, £,{x), i?, 9) is contained in the ball. 

With this insight, we choose Hq :— rci sin(6')/(l + sin(6')), where 9 = tt/3 and ci is the constant from the 
lower bound in Proposition [7| Assuming hx,u ^ ^Oj we will show that given x G Uj, there is a point within 
X n Uj whose distance from x is comparable to hx,u- 

Let x € Uj and consider the ball '^j{Uj). Since the ball satisfies an interior cone condition with radius 
rj > r, by the remarks above we can find a closed ball of radius /ix,m/ci centered at some ^j(y) satisfying 
||\I'j(a:) — ^j(y)|| = /ix,m/(ci sin(0)). We denote this ball by Bi, and note that we have ^""^(Si) C Uj. 
Further, since '^j and its inverse are open topologically, ^^ (^i) is a neighborhood of y and there is some 
closed ball centered at y completely contained in 'i'J^{Bi). 

Let p be the maximum radius of such a ball, i.e. B{y,p) C '^J {Bi) and given any p' > p there 
is a 2;' e B{y,p') such that z' ^ '^J^{Bi). Note that this maximum radius must be attained at some 
z e d'i'J^{Bi). Also note that z must map to the boundary of Bi through ^j: if not, then because ^^^ 
is open, we could find a neighborhood of z completely contained in 'i/J^{Bi), contradicting the fact that it 
was chosen on the boundary. Thus we have: 

P = dM{y,z) > ci||*j(y) -*j(z)|| = ci f ^'^ j = hx,u- 
Since p > hx^m, it follows that there must be a point Xf^ £ X Ci B{y,p) C 'i'J^{Bi) C Uj. Now we have: 

dM{x,Xk) < dMix,y) + du{y,Xk) 

< C2\\'ij{x) - *,(y)|| + callvI'.Cxfe) - ^,{y)\\ 

, hx,u , hx,u ^ C2 / 2 + v3\ 

< C2 ^—^ + C2 < — Ti— nx,M = Chx,M- 

cism(6') d ci y V3 J 

Since x and Uj were arbitrary, this proves that hxnu ,u ^ Chx,M- n 



4.2 Interpolation Error Estimates 

We now have the tools necessary to provide error bounds. First we present estimates that apply to target 
functions coming from the native space of the approximating kernel. After this, we will give estimates for 
target functions that are not smooth enough to be within the native space. 

To derive our estimates, we will first make use of the "many zeros" Sobolev sampling inequality of 
Narcowich, Ward and Wendland, which allows one to extract the appropriate powers of the mesh norm from 
the error function 32 . Here is a statement of that result, stated in slightly stronger form as in [33 . 

Proposition 9. Let Q be a compact subset o/M" satisfying an interior cone condition. Let s > 0, 1 < p < oo, 

1 < q < oo, and let fi be an integer satisfying \_s\ > fi + n/p, or p — \ and \_s\ > fi + n. Also, let X d i^ be 
a discrete set with mesh norm hx,n- Then there is a constant depending only on U, such that if hx,n < C'o 
and if u G Wp{rt) satisfies u\x = 0, then 

Hw^^m < ch'xT''^'^'-'^'^-Hw^m, (3) 

where {x)+ — x if x > and is otherwise. Here the constant C is independent of hx.n o-nd u. 

Recall our notation for kernel interpolants: given a finite node set X, kernel V' and target function /, 
we let Ix.tpf denote the interpolant to / on X found via shifts of ip. Now we are ready to state our first 
approximation result. 

Theorem 10. Let fA be a k-dimensional submanifold ofW^, (f) be a positive definite kernel satisfying (wl), 
and define -0 by restricting (j> to M. Let s — t~ {d— k)/2, and let fi, and q be as in Propositionl^with n — k 
and p = 2. Then there is a constant Hm such that if a finite node set X d M. satisfies hx.M < ^m, then for 
all f e iy"(M) we have 

II -f T f\\ ^ r'hS-ti-k{l/2-l/q)+u rii 

11/ - ^Xj\\w^'-{M} S '-^i^XM ll/l|ff=(M)- 

Proof. Let A = {(C/j,^j)} be an atlas for M satisfying Proposition It] We will choose /im small enough so 
that Theorem [s] holds, and so that Proposition [o] can be applied to the images of all patches in K*^. The 
norm of the error is given by 



\f-Ixf\\wl,^iM) = (Ell^^(/-^^/)l" 



N 



1/2 



Any function projected under ttj is supported on ^!j{Uj), so we have 



Note that Trj{f — Ixf) is a Sobolev function with many zeros on the set "^jiX n Uj). Applying Proposition 
[9] and using ^ with Theorem [s] gives us 

lk,(/ - Ixf)\\w!ti^Au,)) < Ch^-^-'^'^'-'^'^^Wn.if /x/)|k=(*,(c/,))> 
where the constant is independent of X and /. Applying this estimate to all patches gives us 

\\f ~ IxfWw^iM) <Ch^j^ ^11/ - -^a'/||h=(m)- 

Now recall that since we chose (f> to satisfy (II]) , the native space of ip is equal to iJ" (M) with equivalent 
norms. Now use this and the fact that the kernel interpolants have a best approximation property to get 

11/ - IxfU^iM) <C\\f- IxflW^ < C||/|k„ < C||/|U.(M). 

This completes the proof. D 
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When the target function is very smooth, there is a "doubhng trick" from sphnc theory that can be 
used to increase the order of hx,M in the error estimates. This was first commented on for RBFs in R'^ by 
Schaback in [55] and has also been observed in other RBF-related contexts [T71 [Ml ■ The error doubhng on 
more general domains, including Riemannian manifolds, was considered in |40j . and Theorem 5.1 of that 
paper gives pointwise error estimates for very smooth functions in terms of the so-called Power Function. 



Using similar methods along with Theorem 10 we get Sobolev error estimates doubling the order of hx.M- 
A main ingredient for the doubling trick is to rewrite the native space inner product in terms of an 
L2 inner product of functions that have been acted upon by a pseudodiffcrcntial operator depending on 
the kernel. This is achieved in M'* using the Fourier transform, and in the case of the sphere by using 
eigenfunction expansions of the Laplace-Beltrami operator A. For more general domains, one can use a 
well-known result of Mercer to find the appropriate native space machinery. The tools outlined below can 
be found in [40] . 

We define the integral operator T : L2{M) -> L2{M) by 

Tf{x) := / ip{x,y)f{y)dy 

Ju 

Since our kernel is continuous and M is compact, we may invoke Mercer's theorem (see [131 Theorem 1.1], 
for example). Mercer's theorem guarantees a countable set of positive eigenvalues Ai > A2 > • • • > and 
continuous eigenfunctions {(/3n}ngN such that Tipn = Xnfn- Further, {(/3„}„gN provides an orthonormal basis 
for L2{M.), and ip{x,y) has the expansion 

00 

n=l 

Lastly, with these tools one has the following characterization of the native space. A proof can be found in 
[101 Sections 7,8]. 



°° 1 1 

/ . T~(/''i^")l2(M) f 



Proposition 11. Let ^p be a positive definte kernel on M. Then its native space is given by 

M^^lfe L2{M) 

Also, for f^g^ Afip the inner product has the representation 

00 _, 

n—1 

Along with the integral operator T conies pseudodifferential operators T~^, r > 0, defined formally by 

oo ^ 
T-"'f{x) := Y^ -7Zr{f,fn)L2(M)Vn{x). 

The above proposition tells us that a function / resides in the native space if and only if T^^/^y g L2(M). 
Thus we expect functions such that T^^f E L2{M.) to be at least twice as smooth. Below we show that 
these smoother functions enjoy faster convergence rates. 

Corollary 12. Let ip and s be as in TheoremVuX and let f G Af^, be such that T~^f E L2(M.). Then we 
have 

11/ - Ixf\\L2{M} < ChxM\\T^ /IIl2(M)- 

Proof. First, the arguments in Theorem |10| give us that 

ll/-^^/llL(M) < C'hj^.M\\.f-Ixfr^,. (4) 
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Recall that the error g := f — Ixf and Ixf arc orthogonal in A/'0. Using this, the above proposition, and a 
Cauchy-Schwartz inequality gives us 



C30 _, 



< 




\ 1/2 / oo \ 1/2 



- \\T /|U2(M)llffllL2(M)- 

This along with Q finishes the proof. D 

Now we shift our attention to ftmctions less smooth than those in the native space. Finding error estimates 
for functions outside the native space, sometimes called "escaping" the native space, has only recently been 
made possible through the use of "band-limited" functions, which arc functions with compactly supported 
Fourier transforms. Estimates for the escape when using radial basis functions restricted to the sphere were 
given in |30j . where the authors used tools intrinsic to the sphere. To deal with more general manifolds, we 
will lift the problem from the manifold to M'*. 

The results that lead to the escape can be quite deep; to be brief we merely list the properties of the 
band-limited functions needed for our proof. For the interested reader, more details and a complete reference 
list can be found in the survey paper [3S]. The following are consequences of Theorem 3.4 in [33] and the 
remarks thereafter. 

Proposition 13. Let v > d/2, and let X be a finite subset ofR'^. Iff G H''{R'^) then there is an f„ : R'^ ^ R 
such that 

1- fa\x = f\x, 

2. The Fourier transform of f„ is supported within B(0,a) with a ~ Cjqx^^d, 

3- 11/ - /o-||_H-''(Rd) < C'||/||j/,.(Rd), 

where each C represents a constant independent of X and f. 

As the reader will see below, there is apparently a penalty paid for approximating a rough function, given 
by the introduction of so-called mesh ratio, which we denote by pxM '■= hxM/<lx,u- 

Theorem 14. Let M, tp, s and q be as above. Let /3 be such that s > (3 > k/2, and suppose /i is an 
integer satisfying [/3J > ii + k/2. Then there is a constant hyg such that if a finite node set X dM. satisfies 
hx.M ^ ^M; then for all f £ H^(M.) we have 

II f T f\\ ^ r'?,'^~'^~'^(i/2^i/'^)+^^-^ll fll 

11/ - ^X,i,j\\w^{U) S '^i^XM Px.Mll/llfff'CM)- 

Proof. Wc choose ft-M as before. If / G iy^(M), the Trace theorem lets us continuously extend / to H'^{R'^) 
via the map Em, where i/ = P + {d — k)/2. Since /3 > k/2 we have ly > d/2, thus allowing us to find a 
band-limited interpolant /o- to Sm/ with the approximation properties listed in Proposition |13[ 

To get the appropriate orders of the mesh norm, we again use the many zeros result as in the proof of 



Theorem [T0| to get 

\\f ~ Ix,'4,f\\w^iM) < C'^x,M '^W.f - Ix^JWHfiM)- 

The rest of the proof will follow after bounding ||/ — Ix,ipf\\Hi^(M)- Note that since T^falx ~ f\xi we have 

Ix,ipf — Ix,ipTyifa 
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Using this and the fact that all functions involved can be considered traces of function on M."^ gives us 

\\f - Ix,ijf\\HI^{M) < \\f -TufaWH^iM) + \\Tufa - Ix,ipf\\HP{M) 

= ||TmI-E^m/ — TMfcr\\Ht'{M) + II^m/ct — Ix,tl>TMfa\\Hf(,U) 
< C'IIE'm/ — /cr||H''(Rd) + ||7m/(t — Ix,ipTMfa\\Ht>{M)- 

First we concentrate on the leftmost term on the right-hand side. We can use Proposition [13] and the fact 
that / was continuously extended to get 

\\Euf ~ /o-||_ff"'(R'i) < C'||i?M/||ff''(R<i) < C'||/||//pi(M)- 

With bounding the other term in mind, note that since /o- is bandlimited, we have ]„ e A/^, so its restriction 



to M is in M^ = -ff " (M) . Thus we can apply Theorem 14 to get 

IITm/ct — -fx,i/.'?M/cr||ff/3(M) < C''Ix,mII^m/o-||h=(M)- 

The Trace operator is continuous, so we have 

and the fact that ]„ is band- limited with bandwidth a ^ l/'Zx.K'* allows us to apply a Bernstein inequality, 
giving us 

where in the second to last inequality we have invoked ThcoremlGJ Continuing with the estimate. Proposition 
13 and the fact that / was continuously extended from M to M^ gives us 

II /o- II «"(»<') < C'||£'M/||ii-^(Rd) < C'||/||^3(M)- 

Stringing these inequalities together, we obtain 

11/ - -^X,V'/II-H"'3(M) < C'll/llHt<(M) +C'^X,mII^m/<t||h»(M) 
< C'II/IIh'*(M) +C'^X,M9x,Mll/llff'^(M) 



- C'Px.M 11/11 H-^IM)- 



This completes the proof. 



n 



If the nodes are chosen in a non-uniform way, we see that the error bound above might be quite large. 
However, if the node sets one is dealing with are more or less uniform, pxm can be bounded by a constant, 
and one would obtain the typical approximation rates for target functions of a certain smoothness. 



5 Numerical results 

We provide numerical results verifying Theorems [lO] and [M] for target functions inside and outside of the 
native space, respectively. Two different compact embedded smooth submanifolds in M? are considered. The 
first is a one-dimensional submanifold with the parametric representation 



{u,v,w) £ 



1 + -cos 66*) cos 6*, v^ ( 1 + -cos 66*) sin 6*, u; = -sin26', < 6 < 2n 



(5) 

This curve is displayed in Figure 1(a) The second submanifold is a two-dimensional torus with parametric 
representation 



{u,v,w) e 



1 -\ — cos A j cos 6, V ~ I 1 ^ — cos A j sin 9, w = - sin A, < 0, A < 27r 



(6) 
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Figure 1: Compact embedded smooth submanifolds used for the numerical experiments, (a) One-dimensional 
curve Ml described paranietrically by ([5]). (b) Two-dimensional torus M2 described parametrically by (|6|. 
Solid spheres mark the locations of the near-minimum Reisz energy interpolation nodes for (a) N — 100 and 
(b) N = 1000. 



This torus is displayed in Figure [1(b) 

To discretize Mi and M2, we use a hierarchy of node sets with increasing cardinalities. For Mi we use 
cardinalities of TV = 50, 100, 200, 300, 400, and 500, while for M2 we use N = 500, 750, 1000, 2000, 3000, and 
4000. The node sets for both manifolds are obtained by arranging the nodes so that their Reisz energy (with 
a power of 2) is near minimal as described in Hardin and Saff's seminal article [19] . For Mi, this results in 
node sets with mesh norms hx.Mi that decrease like 1/A^, while the mesh norms hx,M2 for M2 decrease like 
l/y/N. Additionally, the mesh ratios px,Mi £md px,M2 remain roughly constant. The small solid spheres on 
the curve in Figure 1(a) display the node locations for the N = 100 node set, while the small spheres on the 
torus in Figure 1(b) display the N = 1000 node set. It is obvious from the latter plot that the nodes are not 



oriented along any vertices or lines emphasizing the ability of the proposed kernel interpolation technique to 
handle arbitrary node layouts on a submanifold. 

The positive definite kernel we use for constructing the interpolants in the experiments is Wendland's 
compactly supported RBF 



03,2(2:, y) = (j)3,2i\\^ - 2/11) = hAr) = 1 - 



18- 



35 



Q- 



(7) 



10 



and 
Ii) and ij3-5 
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(M2) 



According 
2). The free 



which is positive definite in M.^ and has 4 continuous derivatives f44', §9.4]. Furthermore, the native space 
of this kernel is known to be iJ''(M'^) [HJ p. 157], which means r = 4 in Theorems 
to Theorem^ the native spaces on Mi and M2 for this kernel are thus H^{ 
parameter S is referred to as the support radius and its optimal value depends on numerous factors which 
are neither easy nor obvious to determine (cf. [33J Ch. 15] or [201 Ch. 5]). Since our intention in the present 
study is only to provide verification of the error estimates presented above, we set S = 8/3 (the maximum 
distance of any two nodes on either Mi or M2) for all the numerical results and leave investigations of 
selecting S for interpolation on submanifolds to a separate study. 

One difficulty with verifying error estimates of the type given in Theorems [lO] and [14] is coming up with 
explicit forms of target functions belonging to a desired Sobolev space. Fortunately, Sobolev spaces can be 
defined in terms of decay rates of Fourier transforms [HI p. 133]. Using this definition, a straightforward 
calculation shows any function k G M"^ whose Fourier transform satisfies 

^(0^(1 + 11^11^)-'^ (8) 

belongs to every Sobolev space H^{R'^), with /3 < 2^ — d/2. Thus, we can use functions whose Fourier 
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Figure 2: Visualization of two of the target functions for the numerical experiments, (a) The target function 
Q for Ml with m = 25 and (3 — A displayed as the height above the submanifold (i.e. {u,v,w + fiix))) 
together with colors indicating the values of the function, (b) The target function for M2 with m — 100 
and f3 = A with colors corresponding to the values of the target function on the submanifold and black lines 
corresponding to contours of the function. 

transforms satisfy Q with i/ ~ {(3 + d/2)/2 as target functions since they will then be in _ff''(M) for all 
s</3-(d-fc)/2. 

A well-known class of functions that satisfy (Is]) (with strict equality) are the Matern kernels [25] or 
Sobolev splines and are defined as 

Ku{x,y) = Ku{\\x-y\\) = K^{r) = ^, _^,^, r'' / K,,_d./2{r), v > d/2 

where K^_j/2 corresponds to the ii'-Bessel function of order v — dl2. To generate interesting target functions 
for verifying Theorems [TO] and |14[ we use linear combinations of these Matern kernels as follows. Let 
X = {a;i,a;2, . . . ^Xm} be some set of distinct points on the submanifold under consideration (either Mi or 
M2), then the target function is given by 






(9) 



The coefficients ci,C2, 
points in X: 



, Cm are determined by the requiring fp interpolate the following function at the 



p{x) = - (u^ - lOu^v'^ + 5uv'^) {u^ + -y^ - 60w^) 
8 



(10) 



where u, v, and w are the components of x. For Mi, we use m = 25 quasi-minimum Reisz energy points for 
X, while for M2 we use n = 100 quasi-minimum Reisz energy points. Plots of the target function for /3 = 4 
are displayed in Figure l2la) and (b) for Mi and M2, respectively. Note that fp is not the kernel interpolant 
to be compared against the theoretical error estimates, rather it is the form of the target functions to be 
interpolated. 

In the results below, the errors are measured by evaluating the kernel interpolants and the target functions 
at a much denser set of points that sufficiently cover the manifolds. For Mi, P — 3000 evaluation points are 
used, while P — 24,300 points are used for M2. We approximate the (relative) L2(M)-norms of the errors 



15 



by approximating the surface integrals over the manifolds using a midpoint-type rule. We use the following 
abuse of notation to denote the approximate L2(M)-norm: 

II/IIl.(M) := (^Jjf{x)rdx^ « f E^.[/(a;.)]M := ll/ll^.(M), 

where {wi}f^i are quadrature weights for the evaluation points {xi}fLi on the manifold. We also meausure 
the max-norm errors over the manifolds. We use the standard definition for this norm and denote it with 
the standard notation of £00 (M). 

For the first numerical experiment, we set set /3 = 4 in (l9]) for Mi and M2. Since the native space for 



the kernel ([7| is H^(M.^), we expect the estimates from Theorem 10 to apply for these target functions. 
According to this theorem, the £2 errors for Mi and M2 should decrease like h^ j^ and h^^j^ , while the ^00 
errors should decrease like h'jf'j^^ and h'jf'j^^. Figurespla) and (b) display the computed relative errors versus 
the mesh norm for f^ together with the predicted estimates. The figures show good agreement between the 
numerical and theoretical results. 

In the second experiment, we set /3 = 3.5 in (l9| for Mi and M2, which makes the target functions rougher 
than the native space of the kernel and means the estimates from Theorem [Ml will apply. Assuming the 
mesh ratio is roughly constant (which is true for our experiments), this theorem predicts that the £2 errors 
for Ml and M2 should decrease like h'jf'^ and h^ ^ , while the £00 errors should decrease like /i|- j^ and 
^XM,- Similar to the previous experiment, Figures pTc) and (d) display the computed relative errors for 
these target functions together with the predicted estimates. Good agreement between the numerical and 
theoretical results is again displayed. 



As a final numerical experiment, we verify the "doubling" estimates from Corollary 12 For the target 
function we use (10) directly. This function is C°°(M'^) and is thus much smoother than the native space of 
the kernel ([7|. According to Corollary 12 the £2 errors for Mi and M2 should decrease like h^ j^ and /i^ j^ 
for this target function and kernel. Figure Wa) and (b) displays the results for Mi and M2, respectively. We 
again find good agreement between the numerical and theoretical results. The results from the figure also 
indicate that there does not appear to be a reduction in the estimates for the ^00 error for this case. 

Acknowledgments. We wish to express our deep gratitude to Drs. Douglas Hardin and Edward Saff 
and Ms. Ayla Gafni, all from Vanderbilt University, for providing us with the near-minimum Reisz energy 
points for the torus used in the numerical experiments. 
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